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SYSTEM AND METHOD OF ADAPTIVELY RECONFIGURING BUFFERS 

BACKGROUND OF THE INVENTION 

5 

1. Technical Field: 

The present invention is directed to memory systems. 
More specifically, the present invention is directed to a 
system and method of adaptively reconfiguring buffers. 

10 

2. Description of Related Art: 

Due to continued advances in very large scale 
integration (VLSI) technology, processor performance has 
steadily been increasing from one generation to the next. 

15 Input/output (I/O) performance of secondary storage devices 
(e.g., disk drives, optical disk drives etc.) however, has 
not kept pace. Particularly, I/O performance of disks is 
constrained by the amount of time needed to locate and 
retrieve data, otherwise known as seek and rotational times. 

20 On the average, seek and rotational times for random 
accesses to disks are orders of magnitude longer than the 
time required to transfer data between a processor and main 
memory. Thus, a throughput imbalance exists between 
processors and disks. To reduce this imbalance, buffers are 

25 used. 

Generally, most computer systems allocate memory space 
for a number of buffers configurable according to memory 
size and system performance constraints during system 
initialization. Under most operational conditions, the 
3 0 buffers are able to accommodate the data being placed 
therein. In some instances, however, the buffers may not be 
able to handle the size of the data. Particularly, when the 
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size of the data exceeds the size of the buffer into which 
it is being placed, a buffer overflow may ensue. When that 
occurs, the excess data may overflow into an adjacent 
buffer. If data was stored in the adjacent buffer, the data 
5 may become corrupted. 

Some systems allow sophisticated users to manually 
reconfigure buffers. Most users, however, are not 

sophisticated enough to be able to do so. In addition, even 
sophisticated users may not do so if they do not know or 
10 cannot anticipate the size of the data that is to be placed 
in the buffers. 

Thus, what is needed is a system and method of 
adaptively reconfiguring buffers. 
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SUMMARY OF THE INVENTION 

The present invention provides a system and method of 
adaptively reconfiguring a pool of buffers. The buffers are 
5 initially configured to a size (i.e., a current size). Each 
time data is placed in the buffers by an application 
program, it is determined whether the size of the data is 
greater than the current size of the buffers. If the size 
of the data is greater than the current size of the buffers, 

10 the buffers are reconfigured to the size of the data if the 
number of times data of that size is stored in the buffers 
is greater than a first threshold. If, however, the size of 
the data is smaller than the current size of the buffers, 
the buffers may be reconfigured to the size of the data if 

15 the number of times data of that size is stored in the 
buffers is smaller than a second threshold. If due to 
system constraints the buffers cannot or should not be 
reconfigured, a hint may be sent to the program to use data 
of a larger or smaller size. The first and second 

20 thresholds may be reconfigured due to those system 
constraints . 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the 
invention are set forth in the appended claims. The 
5 invention itself, however, as well as a preferred mode of 
use, further objectives and advantages thereof, will best be 
understood by reference to the following detailed 
description of an illustrative embodiment when read in 
conjunction with the accompanying drawings, wherein: 
10 Fig. 1 depicts a conceptual view of a storage subsystem 

of a computer system. 

Fig. 2 depicts an exemplary one -dimensional array of 
counters . 

Fig. 3 is a flowchart of a first process that may be 
15 used by the invention. 

Fig. 4 is a flowchart of a second process that may be 
used by the invention. 

Fig. 5 is an exemplary block diagram of a computer 
system according to the present invention. 



20 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The invention allows buffers that are allocated for 
application programs to be adaptively changed in size based 
5 on the programs' need or usage. To ensure that all 
application program and subsystem needs are met effectively 
and to avoid overuse of available buffers, a maximum size 
and a minimum size threshold are set for each application 
program that is registered for the adaptive buffer 

10 management subsystem. The maximum size and minimum size 
thresholds are utilized to adjust the size of the available 
buffers or to adjust the size of the data being used. 

The buffers may be increased to a size that is a 
multiple of their current size, as long as the increased 

15 size is able to accommodate the data being stored therein. 
Alternatively, the size of the data being used may be 
reduced to fit into the buffers by passing suggestions/hints 
to the application programs about buffer availability. 
These suggestions may fall under different categories such 

20 as critical and non-critical. These can be negotiated 
between the application programs and the system at the start 
of the execution of the application programs, and can be 
renegotiated as often as possible. 

The system may keep a heuristic of buffer usage by each 

25 application program (i.e., sporadic use of a high/low number 
of buffers, or constant use of high/low number of buffers) . 
By doing so, the system may implement a more efficient 
buffer management. For example, if the system realizes that 
a high flow of requests for a high number of buffers is 

30 temporary, the system may try to accommodate these requests 
and as soon as the request flow slows down, the system may 
pull back these buffers to be used for other purposes in the 
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system or for other application programs. The system may 
also communicate the heuristics or the intelligence gained 
from these heuristics to the application programs, to make 
sure that the programs support this type of buffer 
5 management. In doing so, the system may take into 
consideration cache affinity (i.e., whether a particular 
data has already been cached) and warn against cache effects 
when buffers are pulled away from one application to be used 
elsewhere . 

10 The present invention will be described using buffers 

allocated in a system memory of a computer system. However, 
it should be noted that the invention is not thus 
restricted. That is, the buffers may be included in storage 
devices, networking devices, adapters, system heaps, caches, 

15 etc. Consequently, the use of buffers allocated in system 
memories is only for illustrative purposes only. 

With reference now to the figures, Fig. 1 depicts a 
conceptual view of a storage subsystem of a computer system. 
The storage subsystem includes a file system manager 102, a 

20 VMM 112 and a block device layer 130. The block device 
layer includes a device driver 132 and a storage device 134. 
The storage device 134 may be a disk, cartridge, tape or any 
other type of non-volatile memory including network storage. 
It should be noted that the devices shown in Fig. 1 are not 

25 all inclusive. There may be more devices used by the 
storage subsystem. Consequently, Fig. 1 should be taken 
only as an example of a storage subsystem. 

The file system manager 102 interacts with executing 
programs. For example, when an executing program desires to 

3 0 read data, it notifies the file system manager 102 of its 
desire. The file system manager 102 then checks with the 
VMM 112 to see whether the data is already in memory (not 
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shown) . If the data is in memory, it will be supplied to 
the program. If it is not in memory, it will be fetched 
from the disk and provided to the requesting program. 

Accessing the disk to read or write data is a 
5 relatively slow process. Thus, to minimize the frequency of 
disk accesses, a pool of internal data buffers (not shown) 
called a buffer cache is kept in memory. When data is read 
from the disk, it is cached for future use. Similarly, data 
written onto the disk is also cached for future use. 

10 As mentioned before, due to memory size and system 

performance constraints, the pool of buffers may be 
configured to a certain size. Suppose, as an example, they 
are configured to be of 4kbytes each. If a piece of data is 
greater than 4kbytes, more than one buffer may have to be 

15 used to cache the data. In certain instances, some memory 
space may be wasted while in other instances buffer overflow 
may occur. The present invention is used to reduce the 
amount of memory space that may be wasted or the number of 
buffer overflows that may occur when data being used is 

20 continually larger than the size of a cache buffer. 

As mentioned above, minimum and maximum size thresholds 
are utilized to adjust the size of the available buffers or 
to provide hints to the application programs to adjust the 
size of the data being used. The maximum and minimum size 

25 thresholds are also used to ensure against constant re- 
adjustments of the size of the buffers and/or data. For 
example, when data of a size larger than an available buffer 
is continually being used, the size of the buffers may be 
increased if the number of times data larger than the 

30 available buffers is used is greater than the maximum size 
threshold. Conversely, the size of the buffers may be 
decreased if the number of times data smaller than the 
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available buffers is used is greater than the minimum size 
threshold. 

Based on load constraints, the buffers may not be 
reconfigured. In such cases, the operating system may send 
5 a signal (i.e., a hint) to the application program to either 
increase or decrease the size of the data being used. 
Alternatively, the operating system may provide a hint to 
the application program to increase or decrease the number 
of data requests being made within a certain period of time. 

10 The buffers may be increased to a size that is a 

multiple of their current size or decreased to a fraction of 
their current size so long as they can accommodate the data 
being placed therein. Note that the size of the buffers may 
be changed stepwise. That is, if 4kbytes pieces of data 

15 have been used and the size of the available buffers is 
16kbytes, then upon receiving a first signal, the size of 
the available buffers may be decreased to 8kbytes . If 
another signal is received, the size of the buffers may 
again be decreased to 4kbytes etc. Likewise, the size of 

20 the buffers may be increased to 8kbytes when a first signal 
is received and to 16kbytes when a second signal is received 
etc . 

To keep track of the number of times different sizes of 
data are used, an array of counters is used. Fig. 2a 

25 depicts an exemplary one -dimensional array of counters. 
Each location in the array is associated with a data size. 
For example, array location 202 may be associated with 
4kbytes data size. Array location 204 may be associated 
with 8kbytes data size whereas location 2 06 may be 

30 associated with 16kbytes data size etc. Each time a piece 
of data is used, the array is updated. That is, depending 
on whether the data is 4kbytes, 8kbytes or 16kbytes in size, 
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locations 202, 204 or 206, respectively, may be incremented 
by one. 

In this particular example, zero is entered in location 
202. This signifies that there has not yet been a 4kbyte 
5 piece of data used. However, there have been 2 0 8kbyte 
pieces of data used and 60 16kbyte pieces of data used. If 
the maximum size threshold is 59, then when one of the 
counters is greater than 59, as for example in the counter 
associated with location 206 of Fig. 2a, a signal may be 

10 sent to the operating system. The operating system may, in 
response to the signal, reconfigure the buffers to increase 
their size to 16kbytes if they were less than 16kbytes. 

Location 202 of the array in Fig. 2b has an entry of 40 
therein. Hence, there have been 4 0 4kbytes pieces of data 

15 used. According to the invention, if the minimum size 
threshold is 39, a signal may be sent to the operating 
system when the counter reaches 40 (see counter 2 02) . As 
before, the operating system may use this signal to reduce 
the size of the available buffers or to provide a hint to 

20 the application program to use data that is larger than 
4kbytes . 

In another embodiment of the invention, the size of the 
buffers may be increased if data being used is larger than 
the allocated buffer size and the sum of the entries of all 

25 the counters in the array is greater than the maximum size 
threshold. For example, the sum of the counters in Fig. 2a 
is 80, which is greater than the maximum size threshold 
number of 59. Thus, if the size of the current buffers is 
4kbytes and a 16kbyte-piece of data is used, then a signal 

30 may be sent to the operating system. Again, the operating 
system may use the signal to increase the size of the 
buffers, to provide a hint to the application program to use 
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data of a smaller size or to increase the number of times 
data is used within a time period while reducing the data 
size. 

Further, if the current size of the buffers is 16kbytes 
5 and data of 4kbytes is being used, then if the sum of all 
the counters in the array is greater than the minimum size 
threshold, the size of the buffers may be reduced to the 
requested buffer size. As an example, suppose the minimum 
size threshold number is 50 and the sum of all counters in 

10 the array is 60 (see Fig. 2b) then if a 4kbyte piece of data 
is used when the buffers are 16kbytes in size, then a signal 
may be sent to the operating system. As discussed above, 
the operating system may, upon receiving this signal, 
decrease the size of the buffers or provide a hint to the 

15 application program to increase the size of the data being 
requested. 

Fig. 3 is a flowchart of a first process that may be 
used by the invention. The process starts when an 
application program starts to execute (step 300) . The 

20 program is registered with the OS and maximum and minimum 
size thresholds are set for the program (steps 3 02 and 3 04) . 
A check is then made to determine whether data is being 
used. If so, the proper counter is incremented. To figure 
out which counter to increment, the size of the data being 

25 used is taken into consideration. That is, if a 4kbyte- 
piece of data is being used, the counter associated with the 
4kbyte-piece of data is incremented (step 308) . 

A check is then made to determine whether the size of 
the data is greater than the size of the buffers. If so, 

30 another check is made to determine whether the entry in the 
counter is greater than the maximum size threshold. If the 
entry in the counter is greater than the maximum size 
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threshold, then another check is made to determine whether 
more buffer space may be allocated to the program. This 
depends upon the number of programs being executed on the 
system as well as other system requirements. In any case, 
5 if more space may be allocated to the program, the buffers 
may be reconfigured to the size of the data, the data then 
is stored in one of the buffers. Depending upon the 
implementation of the invention, a new maximum size 
threshold may or may not be set for the program at that 

10 time. The process then jumps back to step 3 06 (steps 310, 
314, 318, 322, 324 and 306). 

If no more buffer space may be allocated to the 
program, the OS may then provide a hint to the program to 
reduce the size of the data being used and the process then 

15 jumps back to step 306 (steps 318, 320 and 306) . If the 
entry in the counter is not greater than the maximum size 
threshold, the data is stored into one of the buffers and 
the process returns to step 306 (steps 314, 316 and 306) . 
If the size of the data is not greater than the size of the 

20 buffers, the process may jump to step 326 (steps 310, 312 
and 326) . 

When the process jumps to step 326, a check is made to 
determine whether the size of the data is equal to the size 
of the buffers. If so, the data is stored into one of the 

25 buffers and the process jumps back to step 306 (steps 328, 
330 and 3 06) . If the data size is not equal to the size of 
the buffers it is smaller than the buffers. At that point, 
a check is made to determine whether the entry in the 
counter is greater than the minimum size threshold. If so, 

30 a check is made to determine whether the system is in need 
of more memory space. If the system is in need of more 
memory space, the buffers are reconfigured to the data size, 
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the data is stored in one of the buffers, a new minimum size 
threshold is set before the process jumps back to step 3 06 
(steps 332, 334, 336, 338, 340 and 342) . Note that 
depending on implementation, the invention may reconfigure 
5 the buffers to the smaller size of the data whether or not 
more memory space is needed. 

If the system is not in need of more memory space or if 
the entry in the counter is not greater than the minimum 
size threshold, the data is stored into one of the buffers 
10 before the process jumps back to step 3 06 (steps 334, 33 0 
and 342 or steps 332, 330 and 342, respectively) . This 
process will be repeated for each application program 
running on the system and ends when the system is turned off 
or is reset. 

15 Fig. 4 is a flowchart of a second process that may be 

used by the invention. This process is identical to the 
first process (i.e. Fig. 3) except that the checks made in 
steps 414 and 432 take into consideration the sum of the 
entries in all the counters when comparing counter entry to 

20 max or min threshold while steps 314 and 332 of Fig. 3 only 
use entries in one counter, the proper counter. 

Note that in the example used to explain the invention, 
the maximum and minimum size thresholds are readjusted or 
reset each time they have been exceeded within a time frame. 

25 However, in certain other embodiments of the invention they 
need not be reset. Hence, it should be understood that 
resetting the thresholds is used for illustrative purposes 
only. 

Fig. 5 is a block diagram illustrating a data 
30 processing system in which the present invention may be 
implemented. Data processing system 500 is an example of a 
client computer. Data processing system 500 employs a 
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peripheral component interconnect (PCI) local bus 
architecture. Although the depicted example employs a PCI 
bus, other bus architectures such as Accelerated Graphics 
Port (AGP) and Industry Standard Architecture (ISA) may be 
5 used. Processor 502 and main memory 504 are connected to 
PCI local bus 506 through PCI bridge 508. PCI bridge 508 
also may include an integrated memory controller and cache 
memory for processor 502. Additional connections to PCI 
local bus 506 may be made through direct component 

10 interconnection or through add-in boards. In the depicted 
example, local area network (LAN) adapter 510, SCSI host bus 
adapter 512, and expansion bus interface 514 are connected 
to PCI local bus 506 by direct component connection. In 
contrast, audio adapter 516, graphics adapter 518, and 

15 audio/video adapter 519 are connected to PCI local bus 506 
by add- in boards inserted into expansion slots . Expansion 
bus interface 514 provides a connection for a keyboard and 
mouse adapter 520, modem 522, and additional memory 524. 
Small computer system interface (SCSI) host bus adapter 512 

20 provides a connection for hard disk drive 526, tape drive 
528, and DVD/CD-ROM drive 530. Typical PCI local bus 
implementations will support three or four PCI expansion 
slots or add-in connectors. 

An operating system runs on processor 502 and is used 

25 to coordinate and provide control of various components 
within data processing system 500 in Fig. 5. The operating 
system may be a commercially available operating system, 
such as Windows XP, which is available from Microsoft 
Corporation or AIX, which is an IBM product. An object 

30 oriented programming system such as Java may run in 
conjunction with the operating system and provide calls to 
the operating system from Java programs or applications 
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executing on data processing system 500. "Java" is a 
trademark of Sun Microsystems, Inc. Instructions for the 
operating system, the object-oriented operating system, and 
applications or programs as well as the invention are 
5 located on storage devices, such as hard disk drive 526, and 
may be loaded into main memory 504 for execution by 
processor 502. 

Those of ordinary skill in the art will appreciate that 
the hardware in Fig. 5 may vary depending on the 

10 implementation. Other internal hardware or peripheral 
devices, such as flash ROM (or equivalent nonvolatile 
memory) or optical disk drives and the like, may be used in 
addition to or in place of the hardware depicted in Fig. 5. 
Also, the processes of the present invention may be applied 

15 to a multiprocessor data processing system. 

The description of the present invention has been 
presented for purposes of illustration and description, and 
is not intended to be exhaustive or limited to the invention 
in the form disclosed. Many modifications and variations 

20 will be apparent to those of ordinary skill in the art. For 
example, just one or a multiplicity of threshold numbers may 
be used. The embodiment was chosen and described in order 
to best explain the principles of the invention, the 
practical application, and to enable others of ordinary 

25 skill in the art to understand the invention for various 
embodiments with various modifications as are suited to the 
particular use contemplated. 



